On the asymptotic tightness of the Shannon lower bound

نویسندگان

  • Tamás Linder
  • Ram Zamir
چکیده

New results are proved on the convergence of the Shannon lower bound to the rate distortion function as the distortion decreases to zero. The key convergence result is proved using a fundamental property of informational divergence. As a corollary, it is shown that the Shannon lower bound is asymptotically tight for norm-based distortions, when the source vector has a finite differential entropy and a finite (Y th moment for some (Y > 0, with respect to the given norm. Moreover, we derive a theorem of Linkov on the asymptotic tightness of the Shannon lower bound for general difference distortion measures with more relaxed conditions on the source density. We also show that the Shannon lower bound relative to a stationary source and single-letter difference distortion is asymptotically tight under very weak assumptions on the source distribution.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Necessary and Sufficient Condition for the Asymptotic Tightness of the Shannon Lower Bound

The Shannon lower bound is one of the few lower bounds on the rate-distortion function that holds for a large class of sources. In this paper, it is demonstrated that its gap to the rate-distortion function vanishes as the allowed distortion tends to zero for all sources that have a finite differential entropy and whose integer parts have a finite entropy. Conversely, it is demonstrated that if...

متن کامل

An Improved Sphere-Packing Bound for Finite-Length Codes on Symmetric Memoryless Channels

This paper derives an improved sphere-packing (ISP) bound for finite-length codes whose transmission takes place over symmetric memoryless channels. We first review classical results, i.e., the 1959 sphere-packing (SP59) bound of Shannon for the Gaussian channel, and the 1967 sphere-packing (SP67) bound of Shannon et al. for discrete memoryless channels. A recent improvement on the SP67 bound, ...

متن کامل

Projection to Mixture Families and Rate-Distortion Bounds with Power Distortion Measures

The explicit form of the rate-distortion function has rarely been obtained, except for few cases where the Shannon lower bound coincides with the rate-distortion function for the entire range of the positive rate. From an information geometrical point of view, the evaluation of the rate-distortion function is achieved by a projection to the mixture family defined by the distortion measure. In t...

متن کامل

Statistical Hypothesis Testing and Lower Bounds to the Error Probability

Two alternative exact characterizations of the minimum error probability of Bayesian M -ary hypothesis testing are derived. The first expression corresponds to the error probability of an induced binary hypothesis test and implies the tightness of the meta-converse bound by Polyanskiy, Poor and Verdú; the second expression is function of an information-spectrum measure and implies the tightness...

متن کامل

The Correlation between Sacroiliac Joint Dysfunction and Hip Adductor Tightness

Background. Low back pain is one of the ten most common causes of disability, and sacroiliac joint dysfunction is one of the most common causes of it. Objectives. This study aimed to find if there is any association between hip adductor tightness with sacroiliac joint dysfunction. Methods. Sixty people who had attended our Sports Medicine Clinic took part in this study (30 in each group). The...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • IEEE Trans. Information Theory

دوره 40  شماره 

صفحات  -

تاریخ انتشار 1994